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FOREWORD 



The Design of Training Systems (DOTS) /project objectives are In consonance 
with the requirements of Ad^/^nced Development Objectd^ve ZFN07 (formerly 
ADO 43*-03X)» Education and Training Development. ZPN07 Includes a number , 
o£ projects concerned with demonstrating and evaluating the technical, opera*- 
tlonal and financial feasibility of applying advanced technological applications 
to Improving the training process. 

The Bureau of Naval Personnel Initiated the original ADO In 1966 to make naval 
training more responsive to the changing times. As one project under this effort, 
DOTS was designed to Improve the process of managing training resources through 
application of the techniques of system analysis and system simulation as accom- 
plished through mathematical modeling. The end objective Is a family of computer- 
ized mathematical models enabling training management to more. rapidly predict 
'the Impact of changes In training resource availability or requirements. 

The majority of education and training was reorganized In 1971 under otno^ command , 
Chief of Naval Educatiftp and Training (CNET) . Because of this change, DOTS 
'tesponslbllty was trafflperred to CNET In March of 1972^ more specifically to the 
"l^ralnlng Analysis' and Evaluation Group (TAEG), Orlando, Florida. Th^ ^ 
new CNET organization greatly Increased the' potential benefits to be gained 
f^roffl the increased application of new management techniques and, therefore, 
from thc^ DQSS' R&D effort. Accomplishment of DOTS began In FebruaryNof 1973 
with l^ne majo^^ of tasking being assigned ta the International Business 
Machines Corpotktlon, Federal Systems "Division* Cape Kennedy Facility located 
at Cape Canaveral^ Florida. ( 

In conducting the Phase I study and ditflnltlon effort, the TAEG/IBM technical 
team conducted multl-lev^el Int^i^^^ews at .some eighty activities or training 
related groups within the Naval E^b^lon and Training Command (NAVEDTRACOM) . 
The willing and competent participation of all personnel 'contacted Is gratefully 
acknowledged.' During this Phase IV task, JIOMTRAPAC and its activities provided 
exceptional cooperation and contributed sl^^flcant time and Interest to the 
data collection and evaluation effort. Specif appreciation Is expressed for 
the p)Eirtlclpatlon of LCDR T. Ferrler, COMTRAfAO, who served as the liaison and 
primary Interface with the command. 

" - • ■ ■ • ••>; ■ 

The TPF and SCRR models evaluated In this field ;)fest>ere developed^ by Mr. K. 
Branch and Mr. R. Yanko, respectively., Systems Programming support was pro- 
vided to the modelers by Mr. J. Staley. Messrs. K. Branchfs^L. Duffy, and 
R. Yanko partl'clpated In the field test at COMTRAPAC. Mra.«%i Rellly provided 
editorial iLnd secretarial services. Mr. R. Hallman was Project Manager. 

The Training Analysis and Evaluation Group, Dr. A. Smode, Dl^ectolTi^ project 
team members Mr. M. Mlddleton and Mr. W. L'lndahl, complemented^the c^dntracted 
effort by providing direction and guidance, establishing organizational Inter- 
facesy and assisting in the performance of the utility assessment;; * ' 
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This final report summarizes the results of a field test conducted for 
the pujspose of determining the utility of the TPF and SCRR models to 
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providing technical guidance and support. The ovelfall DOTS' objective 
Is to provide Naval Education arid Training Command (NAVEDTRACOM) manage- 
ment with additional tools In the form of computerized mathematical 
models to assist In predicting' the quantitative Impact of training 
resource decisions. The planning process will be enhanced by providing 
decision makers with the culpability to economically and rapidly consider 
a wider range of alternatives. 

Phase I was a study and deflrtltlon effort resulting In a complete function- 
al, description of the NAVEDTRACOM; a strategic definition of the social, 
political, economic and technological environments pertinent to the 
naval education and training system in the 1980' s; a list of existing 
and potential models amenable to computerization and to improving the 
decision-making process. Phase II was devoted to the selection and 
development of three mathematical models from the Phase I list of candi- 
dates. The three were the System Capabilities /Requirements and Resources 
(SCRR), the Educational Technology Evaluation (ETE), and the Training 
Process Flow (TPF) models. 

The Phase IVi field test was performed at-COMTRAPAC and five of its 
subordinate activities, in San Diego, CA. During the field test,- a data 
base containing courses, instructors, and facilities was established for^ 
each COMTRAPAC activity. Management applications of the models were 
then identified; some were tested using the models operating on the 
real-world data supplied by the activities. At the same time, a number 
of enhancements were identified for improving the use of the models and 
data base. Finally, a review was conducted by the Training Analysis and 
Evaluation Group (TAEG) with participants^ from COMTRAPAC and each activity. 

In summary, a number of recommendations were made to improve model and 
data base usage, and the general view was that the models could be 
useful as management tools if identified deficiencies were corrected. 
However, without further evaluation their value could not be established. 
Therefore, the decision was made to incorporate several of the enhance- 
ments Whereby the transition can be made from R&D to jthe operational 
phasep^when resources become available. 
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SECTION I O 
TASK INTRODUCTION 



BACKGROUND 

In Phases II and III of the Design of Tralnfng Systems ,f(DOTS) project, 
three computer-based models were designed, developed, and validated. 
They are the Systems Capabilities/Requirements and Resources (SCRR) 

; ''^'c/'?^"^"^ Process Flow (TPF) model, and the Individualized 
Training Simulation System (ITSS) model, A data base for storing cer- 4 
tain types of training Information required to drive the modeis was also 
developed. The prograianed models and data base reside In a tlmesharlna 
compdjtex; system operated by National CSS. Inc. " The models and data base 
a^e atcesslble on an interactive basis using a remote display terminal 

A !LJ?l^P'°cesslng link to the host computer. Two of the models (SCRR 
and TPF) were selected for field testing at! the headquarters and i^^tlvi- 
ties of the Commander Training Pacific (CGMTRAPAC) . The SCRR and TPF 
models and associated data base are described In detail in several 
previous TAEG reports. 1 However, the general DOTS system relationships 
are shown in Figure 1 and the two models are briefly described below in 
order for the reader to acquire- a sufficient understanding for purposes 
of this report. Also contained in each description is a list of the 
training panagemeiit appicatlons in which context model utility was to be 
demonstrated during the field test at COMTRAPAC. 

THE SYSTEM CAPABILITIES/REQUIREMENTS 'AND RESOURCES MODEL. The SCRR 
model is a linear pijogrammlng (LP) optimization model. The SCRR model 
formulates an LP ojijective function and constraint equations from infor- 

aJM™?,^;^!^"^ ^" "^^^ ^ P"^l«» i« then solved to " , 

optimize training complex ^dent throughput and resource utilization. 

rpJiSJoin! "°?u^ ^ of operation. Ip the first mode, the 
resources; i.e., the classrooms, laboratories, /Instructors, and the 

limitations applicable to each, lare specified, 
and the model determines the maximum student throughput and the optimal 
mix of course convenings which can be attained in a specified time 
IaZz' ^ ^^"""^^ desired output profile Is specified, 

and the model determines ttie^lnlmum combination of resources required 



^^G R^orf ll' J Final Report, Volume 1, dated December 1971 

T^6 rSo« So' ^2 0 JJ««^ J/in«l^ Report, Volume 2, dated DecembS 1974 
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to produce It. The model solution consisting of the linear programming 
solution and the sensitivity analysis, gives a. total picture of the 
training complex output and the utilization Of each resource. Factors 
are presented w)iich indicate the ef fectiveiJess of, and the limits for, 
manipulating each input variable without impacting the optimal solution. 

The SCRR model can be applied In the following specific types of situa- 
tions: , > ^ 

a. Assessment of long-^-term training demand. The SCRR model in 
its first mode of operation will optimize the number of course - 
convenings or stqdent throughput within stated resource con- 
straints. It can be used, therefore, to determftie whether 
annual training requirements are feajUble. If demand is 
projected beyond the coming year/ the SCRR model can signal 

^ the need for additional facilities before present facilities 
are exhausted. The optimized convening rate can serve as a 
guideline for course scheduling. / 

- , ■■' '* C ■ ' , . ■ ^ 

b. * Assessment ofMhe impact of ghort-term demapd that might 

arise from unscheduled events,' such as a ship repair 'opera- 
. tlon; an activation of reserves, or unusual seasonal 'recruit- 
- ment levels. In these instances, the SCRR model maximized 
throughout -by cpurse would setve as an immediate indic^tit)n* of 
training complex capability. If necesdary, a training manager 
can alter the present course convening schedule, deleting low 
k . prior:^ty courses to gain classtoom spkce, and possibly instruc- 

tor^, for addftional sessions of high priority courses. 

c. .Assessment of the use of training resources. In^its second 

^ mode of ^ operation, the SCRR model will take the current through- 
^ put rateQ and determine the optimum combination of resourc^ls 
required to produce them. . In this mole of operation, the ^ 
model output can be compared with real resource utilization to 
obtain estimates 6i the effi^jiency of training complex resource 
use. • 

d . (&mparison of ' alternative training.:ln5)leffiena tlon^trategie . 
Eithei^toode of operation may be used to evaluateT^f ferentf 
combln^ons of training technologies (when average- time- to- 
complete, etc.\, are supplied) . In addition, the sensitivity 
analysis gives^n^^yiaic^ionlof the sensitivity of the training 

^ - domplek throughput to each resource. Sensitivity factors ^ 
^ Indicate the range over which the resource may.be manipulated 

without affepti^g'the optimum convening/ througjiput. rate. The 
training manager can easily determine the limiting resource 
for any particular ser^of xrondltlbns, and apply his energy ^ 
effectively by dealing with the most crucial problei. lf,-^or 
example, instructor availability proved to be the ^mi ting A 
factor on one coiirse,'^cross-training of present j^£aff might 1 
prdve to be the most cost-effective way to ineWase school ' / 
throifghput. ' 
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In sumpary, the SCIOt ii^odels has two basic modes of operation. In the 
first 'mode, training comp^Iex throughput is, maximized within specified 
constraints and available resources; in the secciincl. mode, the throughput 
by course is specified by the user, and the model outputs tl^e optimum 
(minimuiii) taiK o£ resutixee» required to produce chat ^roughput. By - ^ 
using one. or the other of these modes of operation a8^appropriaite, the 
tr&iiilng official or tralnli\g staff , member laay plan for^jneetlng projected 
demand, solve resource use problems, or assess different traWng Imple- 
^mentation sti^tegies. ' * " 

THE TRAINING PROCESS FLOW MODEL. The TPF model is a*' simulation ^inodel. 
It uses information contained in the data base tp create an aggregated 
dat:a matrix, updn which the execution module logic operates in order /ttf 
calculate output quafhtlties which '^^redlct tralnin| .system performance* 
The key elements of the TPF are the profiles of course characteristics 
and student characteristics by course. The profiles and the weighting 
factors associated with them were created by statistical an£ilys is of 
bistorlcal data from BUPERS and the Fleet Training , Center, Norfolk^. 
Virginia. A substantial portion of the student performance data was not 
in an Autdtoted Data Processing (ADP) form, and had to be gathered \ 
during instructor interviews* It was not necessary to peifform additional 
statistical analysis at COMTRAPAC^slnce the TPF' logic was found gaeerally 
applicable to COMTRAPAC training. ^ J' 

Basically, the TPF starts with a course convening schedule obtained from 
the dsta bade, or .an^ptiml'zed convening frequency obtained from the 
SCRR model. The profile characteristics of the student groups are then 
compared with selected course factors;. e.g., failures, dlsenrollment', r 
etc., versus demand, ^^^fec^og, etc., and the throughput , of the training 
complex -is predlcted.^^ In addition to throughput, certain aspects o*f 
resource utilization are calculated from the ptedlct^d throughput versus 
maximum capacity figures.* " ^ T 

Although the TPF model is Intended as a resource utilization control 

tool similar to the* SCRR, because its . design iifeorpprates'^ studei^ chare ter 

Istlcs and addltlj>i^^ course information, its a|(]^llc'atl5lts--ft^^ 

cantly diffejefitT The TPF model can be appli^d^ln the following specific 

types of situations: ' ^ ^ 

a. ^ Simulation of the training complex to' determine the<«accisnulated 
' effects of demand; In this type of application, the TPF will 

assess the average-on-board, the! training complex througjiput, 
. . ^ and the stuljent backlog that builds if derifiand exceeds the 
* enrollment capability. { ' 

. :/ \ V ' ■ . ^ ■ 

b. Assessment of overutlllzatlon or underutillzatlon of iresources 
at the course level .^ In this appillcatlon, thekbdel is used 

^ - tp evaluate the e^^ts of increasing the danan^jldr a particular 

^course. Evaluation of the capacity, utlilzatlcn^ no^show ' 
data will determine the need for scheduling'jdiitional sessions 
of the course or tightening the input requl^ments and the 
methods of reserving space ln^class# • ^ ^ ^ ' 
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c. Analysis of the effects of changes in student performance; e.g., 
failure rates, setback rates, etc., oh training throughput. 

In sunanary, the Training Process Flow inodel can be used in the analysis 
of resource utilization atuthe training complex level, or at the individual/^ 
course leVel. The TPF can assess, the ef/ects of changing th& student 
quantity and/or performance. As a simulation tool, the TPF allows' the 
training manager to evaluate different tinning resource utilization 
strategics in terms of -overall 'training rtm^ementatioh efficiency. 
While the Stm can determine the maximal throughput based on total class 
capacity and convening frequency, the TPF, can predict actual throughput 
based, on the maximal throughput, student attrition, andfkno-show data. ' 

FIELD TEST OBJECTIVES 

The primary objective 6f this task was to demonstrate the usefulness of 
the SCRR and TPF models to Navy training managers. Toward this end, ' 
real i/orld model application were identified; the models were then 
, applied in the analysis and solution of specif ifc training situations. 
Dacumented appli^a'fcipns were distributed' to Navy training petsonnej^ with 
accompanying queatlons to determine staff workload associated with each 
application. The questionnaire inputs were the basis for assessing poten- 
tial model benefits in relation tp these operational costs. 

' A secondary objective was to define- enhancements to the model and data 
baafe whlch^ight signifdLcantlj^^ increase their value tfo training managers. 
'Enhancement modifications were identified during meetings, interviews, 
presentations, and demonstrations. The list of proposed enhancements 
wa8.reviewe4 and high priority items were further analyzed in terms of 
the additional development costs. Certain enhancements were Selected as 
having^ substantial benefit as cibmpared to cost, and will be incorporated 
Into the models and data base design. 

TASK ACTIVITIES InD SCHEDULE OVeWiEW 



Five major definable tasks were performed in order to complete the field 
test. Briefly, they can be described as follows; greater detail is pro- 
vided in Section II of this report. ^ 



* o Install Software at TRAPAC 



The TPF and SCRR ^models arid support programs we're reinstalled ' 
in the IBM CKP workspace gt National CSS . Some minor midif ica- 
tions were made at that tSfie. The data base format was defined 
and data were collected from five TRAPAC activities. A perloll 
of data base purification followed the initial TRAPAC data 
load operation. ApproximaietLy five thousand records (punched 
cards) wete inputted to establish'Vthe data base. 

Identify and Document Model/Data Base Applications 

The five TRA^C activities inlolved in the field test were 
briefed on the purpose and schedule for this particular task, 
as well as the following threi tasks, which culminated in a 
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r*vl«w of the £l«ld t«at ristilts by thi •valuation t««n. Th« 
objfctlvt wai to Identify sltuatlona atlalng during the nOraal 
coi^a of unaglng training to vhich the nodeia fslght potan- ' 
tlally apply. I^apartmant/dlvlajLon haada and ataf f paraonnal 

• vara Intarvlawad in ordar to Idantlfy thaaa altuatlona. Tha 
raault waa a llat of- potential applications. 

0 Utilize Model Sof tware'*|ind TRAPAC to Solve Identified Prpbleaw 
' . \ ^ ■ 

Several of the potentlel'nodel eppllcetlona were enalyaed to 
e greeter depth. C^engea dr Inputa to' correapond with the 
approeph teken by trelnlng nanegera In reaolvlng a particular . 
problea altuatlon were prepered. The appropriate nodal waa 
run and reaulta were compered' with thoae expected by the 
trelnlng managers . Only a few tests of this type could be made 
beceuse of time constrelnts end dete Inconsistencies. 

o Define Useblllty Enhencements 

During* the briefings end subsecjuent'ljitjprvleWs, mPAC activity 
peraoimel Identified e number of chaffgea or addltlona which 
they believed would make the models more sultabln to their 
uae. Theae ranged from minor dete baie modlflcationa to. new 
eddltlonal modiling tasked jM4«t of proposed enhencements 
wes maintained for leter analyais, prioritization, end possible 
development. 

o - Review by Eveluatlon Team 

. : f 

A questlotmelre wes developed for TRAPAC personnel to determine/ 
the frequency and essoi^eted workloed on identified eppllcarr / 

• tlona. The results wer^ tabulated and presented to key persop/ 
msl.at each activity. Activities were requested by TOAPAC to 
develop a position statement regerdlng the usefulness of DOTS 
models to the management of training within their function. 
TRAPAC, Activity, and TAEG peraonnel (IBM repreaentetlves were 
not present) reviewed the overall field test results to decide 
the future course of the DOTS effort et TRAPAC. A decision 
was made to Incorporete certeln enhencements whereby the *trensl- 
tlon cen»be made from R&D to the Operetional Phase when resources 

, become available. 

The major mlleatones achieved during the field teat effort ere Hated 
below; the overall taak achedule la ahown In Figure 2. - 

o;' 8 Jenuery 1976 - B^en Anelysls ° - jinltlel TRAPAC Briefing ^ 

o ' 15 Jenuery 1976 - Co^p^ted Initial Date Collection Pheae ' 

o 23 Jenuery 1976 > Completed Activity Brief Inga 

o . 26 Jenuery 1976 - Completed Inltlel Dete Baae Loed 

o /27 Pebruery 1976 - Completed Appil|etlona Analysis 

<? 3 ilarch 1976 - Completed Field Test ^Evaluation 
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FIGURE 2. FIELD TEST jSCHEDPLE * 
FIELD TEST PAI^CIPANTS * 

Five activities within COtTTRAPAC participated in the field' test, namely: 
o Fleet Antisubmarine Warfare Training Center, Pacific (FASWTCP) 
o Fleet Combat Direction Systems Training Center, Pacific ^FCDSTCP) 
o Fleet Intelligence Training Center, Pacific (FITCPAC) 
o Fleet Training Center, Pacific (FLETRACEN) 

0 Nuclear Weapons Training Group, Pacific (NWTGP) 

In addition, several staff codes at COMTRAPAC participated. 

On 8 January, a meeting Was conducted at COMTRAPAC to btief key personnel 
within COMTRAPAC and its activities on the objectives and apprdach bf the 
field test. Approximately 20 persons attended this meeting. Each actilvity 
was given data collection forms and instructions for gathering course, 
instructor, and facility data. 

During the week ending 23 January^ briefings we^e held for staff, depar:^- 
ment, and division heads (or their representatives) at each of the 
activitlea. Approximately 50 persons attended this series of meetings 
whj^h initiated the applications analysis phase of the field test. 

A listing of meeting attendees is provided in Appendlx*A of this report. 

1 ^ 

Following the applications analysis briefings, interviews were scheduled 
with various COMTRAPAC and activity personnel. During these interviews ' 
departmental data were reviewed, model and data base capabilities were 
demonstrated, potential applications were elicited, and usability 
enhancements were identified. A number of persons who had not attended 
prior briefings were contacted during this interview phase. 4 

7 

15 ' 
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SECTION II 



FIEU) TEST TASK ACTIVITIES - DISCUSSION 
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The five major task activities cbnstituting the f^eld test for deijion-" ' 
strating SCRR and TPF model utlfity were briefly described in Section I. 
This aectibn presents those task activities in- greater detail, ani 
displays key exhibits of forms, presentations, etc, used in accomplish- 
ing the field test. ' - . *■ 

FIELD TEST OVERVIEW ' . , • ' . ^ 

The purpose of the field test was to demonstrate the degree of utility 
that two previously developed models (SCRR and TPF) and associated data ' 
base would have for Navy training iianagera at the activity and function- 
al command ^evel. The two jnodels with some minor modification were 
installed in the National CSS system in Norwalk, CT, and we?re accessible 
via a teleprocessing terminal at San Diego. Course, instructor, and 
facility data were collected from five COMTRAPAC activities in order to 
establish the data base- from which the models tould be operated. Follow- 
ing command briefings, a number of key personnel were interviewed to 
Identify situations with which they were confronted where the models and 
data base might help. Once the potential applications were identified, 
a questionnaire was prepared and distributed throughout the command. 
Its purpose was to determine the frequency and amount of effort expended 
in handling each of the identified situations. The survey results were 
then sunparized and presented to key personnel at each activity who were 
requested to establish their activity's position, on the utility of the 
models and data base. The position statements with their comments and 
qualifications constituted the major input to the decision on whether to 
continue at COMTRM'AC. The decision reached by the Training and Analysis 
and Evaluation Group (TAEG) and COMTRAPAC was to incorporate certain 
utility enhancements, provide support to COMTRAPAc through June 1976, and 
to seek a sponsor to provide operational funds for the future. 

INSTALL SOFTWARE AT TRAPAC 

The 5CRR and TPF models were installed into the IBM CKF workspace on the 
National CSS, Inc., computer. Several minor modifications were made to 
facilitate their operation at TRAPAC. i 

SCRR. The following changes were made to the SCRR model operation, 

^ o Revised permit multlplelevels of analysis within the 

school code; i.e., by activity, by department, or by division. 

o Revised to operate selectively from either the master or 
scratch data bases. 

0 Added a facilities assignment and -atilization report * 
similar to the existing instructor assignment listing. 

TPF. The following changes were made to the TPF model operation: 

o Revised' to permit multiple levels of analysis within the ^ 
school code (same as SCRR) . ^ 

. 16 ■ 
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o Revised to operate for any one or coiablnatlon of the three 
fiscal years of data contained In the data base. 

o'^^'^'^^dlfled the no-show alg<ftlthia to more closely reflect the 
quota control' system at TRAFAC. ■ ^ 

. . * 

DATA BASE. The major effort within thli taak activity waa the eitabliah-r' 
mant of a data baae for the five activitiea participating In the field 
teat. Thla waa neceaaary In order to denonatrate model and data baae 
appllcatldna to the varloua training ataff and management peraonn^l. 
While much of the data waa contained In eatabllahed data baaea; e.g.v 
NITRAS^ It waa decided due to preaent data Inaccuraclea and the time 
required to atructure and perform the ^ata tranaf er to the; DOTS data baae 
manual collection would be more efficient for the field test* 




Data collection forma were diatributed at the '8 January meeting. Theae 
were copiea of the key punch aheeta for Qourae Carda 1» 2 and 3» Inatructor 
. TSarda l and 2» and the Facilitiea Card. The forma wete the aame aa prevtoualy 
uied in building other teat data baaea and are ahown in the prior documentation 
. ^y4eferenced in Section I of thla report. Inatructlona deacribing each of \the 
>Cdata fielda were alao provided and are ahown in Appendix B. Note that the 
^\three flacalTyeara of data requeated were 76» 77» and 78. To almplify the 
l^rocaaa» FY 7T waa not included in the data baae. 

/Several changea were made to the data baae and to the data baae programa 
iifiring the Inatallation phaae. Theie were aa ^followa: 

\ . / I ' 

>' o Redefined the data baae deacripticn: to eliminate the timekeeping 
' ^ fielda previoualy contained withinl the Inatructor file. 



b Changed « the definition of the three courae length fielda to 
allow lengtha of 100 daya or more to be entered.^, 

o Redefined the uae of aeyeral fielda to permit CONTBAPAC 
requeated data to be collected; i.e. » the J^Number (JNO) 
field waa uaed for the maximum daaa capacity ,| and the. 
Planned AOB (PAOB) fl/eld waa Uaed for minimum claaa capacity. 

\ o -Redefined the uae of the achool code (SCH) field vdealgnating ^ 
, y^px^ high order aa a tmique nuinber for each activity i.e. » 
;4 - NDWPNTRAGRUPAC. 5 » FtTCPAC, 6 » FLETRACEN SDlEGO. 
7 - FLTCOMBATDIRSTSTRACENPAC, and 8 « FLEASWIRACBMPAC. 

'^'\ ,' " ' 

' o bi^eldped aeveral^programa to facilitate data editing prior 
tU\loading.RAMIS.2 

Keypunch carda^re inputted through the OFFIilME READ facility at National 
CSS» Inc.» in %an Diego. Table 1 aummariasea the nund}er of data entrlea 
required for eac^ activity and department/diviaion to eatabllah the three 
data bAae fllea| l.e.» Courae Flle» Inatructor File; and Facility File. 



^WflS la a proprietary program developed and maintained by Mathenatlca, 
Inc. : ^ • • . 

■ • ' • ; . ■ ; 17 . . ■ ■ . . 
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TABLE !• MTA BASE ENTRIES BY ACTIVm 



ACTIVm/DEKT/DtV 

WUWPHTKACItUFAC DEFT 

430 (30) 

* 440 (40) 

450 (50) 

460 (60) . 

470 (70) 



INPUT RECOKDS 



or COURSES ^ COURSg file INSTK file facility MLR 



19 

I 

9 
5 
3 



175 
.4 

7a 

34 
42 



30 
1 
9 
6 
7 



TOTAL 



119 



FLECOMBATDIRSYSTIUCENPAC DEPT 

7k (31) 6 

7B (32) 4 

7C (33) 4 

7D (34) 9 

7E (35) 9 

7P (36) 4 

7G (37) 10 

7T (41) 14 



1020 

TOTAL INPUT KECOItDS 



.144 
^^107 

57 

96 
137 

6P 
^ 97 

42 



174 
1379 



i 



17 

,11 

9 
13 
10 
12 
|_ 



fOTAL 



FLEASWTRACENPAC DEPT 

621 (21) 

822 (22) 

823 (23) 

824 (24) 

825 (25) 

826 (26) 
661 (61) 
862 (62) 

663 (63) 

664 (64) 

TOTAL 



TOTAL INPUf RECORDS •,1728 



35 
1 
9 
5 
6 



TOTAL 






333 


53 


56 






TOTAL 


INPUT RECORDS 


-442 




TITCPAC 












5IHT (ALL) 


13 


TOTAL 


192 

INPUT RECORDS 


16,^: ./ 
» 260 


52 . . 


FLET^EN SDIEGO DEPT ' 
6A*(20)* 






/ 






39 




309 


56 


' 43^ 


6B (30) 


10. 


89 


20 , • 


15^ 


6C (40) 


31 




206 


^30 ^ 


74 ♦ : . 


6D (50) 


25 




176 


23 


33 


6E (60) 


14 




236 


43 


20 X. : 



165 



20 
6 

i 

14 

10 
17 



60 


'735 


^85 < 


98 




tOTAL INPUT RECORDS 


- 916 




18 ' 


424 


93 


45 


20 


212 


50 


37 » " 


11 ^ 


' 185 


42 « 


36 • 


1 


90 


29 


10 r 


1 


123 


.31 , 


8 


. 1 


4 


16 


t 


. 5 ^ . 


26 


9 


10 / 


6 - 


39 


11 


16 


■ ^ - .4 




■ $ 


7 


7 


114 


20 


8 


•72 


1245 


306 ' 


177 



TOTAL ALL ACTIVITIES: 301 



35W 



634 



568 



TOTAL INPUT RECORDS « 4727, 
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IDENTIFY AND DpCUMENT MODEL/DATA BAS'E APPLICATIONS 

During the week beginning 19 January. « series of Individual activity 
briefings were held. A presentation covering the following Iteas was 
nade. ^ * 

o Purpose of vl^lt to GOMIRAPAC activities n . 

o Tasks and project schedule 

o Background and purpose o£ DOTS 

. o SCRR model description and appllc^atlons 

'o TPF model description and applications* 

o Data base description ax)d application : ^ 

0 Specli^cs of this appilcatlopi analysis task. 

Each of the meetings* las ted apiiroxfiiiatliy 1^ houra and attendees were 
provided with copies of selected material from the presentation. 
Approximately fifty persons atten4e4 the \f our meetings (FASUTCP and 
, FITCPAC activities were combined); attendees are listed In Appendix A. 

From 26 January through 27 February, Interviews, presentations, and 
demonstrations were held a tl all activities. These were generally held, 
on an Individual basis with ke}^ staff personnel and department/division 
.heads for the purpose of Identifying applications >where use of the models 
and/or data base could be of assistance. In addition, enhancements and 
new applications were Identified. 

' ." ' ' . s ■ ■ ' ' * 

MQD^L APPLICATIONS ANALYSIS. The analytic framework for Identifying 
potential model applications was a series of topics posed to the person- 
nel being Interviewed. The questijOids were not rigidly adhered to, 
howeveif, the iEollpwlng presents the general outline of categories used 
during the Interviews. # 

o Sl|tuatlon Description: (ProblcM, "what ifs". Feasibility 

Studies, itc.) ' ' " / . . ' 

^ / ^ Mission' to which situation solution contrlb 
Specific situation desctiptlon. 

Origination' of situation^ ^ « • ' 

* ^ Seriousness of situation. loq^^brtance of solution. ^ 

Areas impacted by situation. 

_ , -^-v.^ ,y ; ■ • ^ ■■■ ■ ■;. ■ 

o Ndrmal Apprigii^ih to Solution: ^ ' ^ 

Who works out solution. v 
Informat;:lon requirements. ^ 
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Sources pf Infbnnatiott; ^ . 

Tine to solve, , ,^ \ * ' 

Frequency of occurreiure. > . ' , • ^ 

^ Users of solution* . 

■* ■ ' ' i' * . ' 

o Present Solution: * 
Quality of 'Solution, v ' > 

^"^o Model Approach to Sola tiom , ^ 



ModeKs) ui^, * 
Input- data e];^ent8« 
Model Solution: 



Comparison to present solution. . . a. / 

POTENTIAL WDBUNG/DATA BASE APPLICATIONS, The following list of potential 
applications was conpiled during the hrtefingt 

sessions.;. .* ;\ • ..//^ y-" 

1 . ^ Assess the effects of reducing iaervlce training related j 
^ manpower >y some specific percentage; -e.g. ^ 5 percent, 

10 percent or 30 percent. V ^ 

2. Assestii qapahUlty to handle an increased training load for 
/ a specific course^ using existing Instructor aiid facility 

resources; e.g.> GMT A-School load Increaseii from 220 In 
FY 76 to 340 In FY 78. 

3. Assess* effect on training throughput f rom 'reditircin|; (or 
Increasing) liSstruc4&or weekly contact hours;^fw|* i f tom *2S 
down to 20 or to 15. • , / 

'^4. Assess utilization or proposed expanded physical plant In * ; 
handling a projected futiirie tt»lAlng load; e.g..>, use / ■ ' 
utilization from future demand figures in Justifying MILCON 
funds to expand physical training plant. . ' ^ 

5. Assess Impact upon training throughput from permitting / > 
Increased non<« training use of tralners/mockup/etc ; e.g^ y * 

- additional shift use of TACDEW by support group. 

6. Raevali^'ce baseline - 
In methodology, co^pufcatlpn^^^ 

J ^ change In coiiiieae lengths from student .day to calendar • -J^ - 

day> recaicu|^iat^n of AOB based on new formula|> etc. 

7. Evaluate the effects upon spedlflc courses or ^a^^ 

In generiil a,a a result of, different quota control strate- 
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/ g±Mi e.gk» oyer-'boQiclngr substltutt quota enqphasls In 

reducing no ahovs^ etc. * 

ft. Perform apeclflc manipulations of data base elementa to^^, 
Identify ptoblem areas on ah eicceptlon basls^ e.g. ^ which 
; courses have a demand exceeding capacity by X percent^ which 
' courses have X percent excess capaclty» which courses have 
inconsistencies between their lengtjtiy total facilities 
requlremehtSi and Instructor contact hours» ^tc. 

9. Analyase equlpmeh,£!^utlllzi^tlon and. constraint effects from 
varying team tralMng demandii. Diptermine sensitivity of 
throughput capabllltjr to different demands. 

)<hlle varlatli^ns of the, above general applications list were Identified^ 
when considered In a broad context ^hey appeal^ to be a fairly exhaustive 
representation of the types of situations to which the existing podels 
and data base could be applledrMwo other areas frequentl};/ mentioned 
dealt with student data and cost data. The existing system not 
treat jthese two categories of .data« 

.m|zE HOOEL SOPTHABH T^^^^ 

Sone o£ the model/data basfe applications identified during the course 
of the Interviews were actually run on th<i conputer using the existing /> 
models (with some of the jwdlflcatlons previously mentioned. Installed) 
aM the data base which contained course^ Instructor, and facility data 
for each of the five participating TRAFAC activities. Following are 
sunnary descriptions of some applications demonstrated to IRAPAC personnel 

during tlie field test. 1 " 

■ ■ ' . ■ . • "... ■ ' . ■ 

1. ' ' In January, CNET requested that all CNE^ functional commands 

, (and their activities) assess the effects of 10 and 30 percent 
personnel reductions from planning level without corresponding 
reductions In planned AbB loads. , 

The SCRR model was applied In the analyils of this problem for 
several dejE>artm«tet8. Because foiilet data ara not incorporate 
m the existing datli base, only the effects f tt>m ellmlnatliig 
- existing peJrsonnel could be evalusTted* the modeiett rasul^^^^^^^ » 

showed th. redlsttlbution of ^^d^^^ . ' 

personnel. Mso, alqce support hours w^^ 

contact hours had to be evaluated with a knowledge of the addi- 
tional wprklbad tequirments which" might exist for remaining , 
persbnner. 

2. i)ne coirrse was analyzed for the effects of a projected signlfl- 
,Cant stud^J^ad increase. AS trtth tlie previous €atan?»le, the ' 
SCRR model^runAshowad the redletrlbutlon of contact hour time ' 
across remainl;ig Instructots. Because support data w^^ 
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4. 



6. 



available, however, J^udgmWs hadiKo be made regarding the new 
contact hour tines. , ' 

Oiie of the activities 'was updating a Basic Facilities Requlrer 
•ment's List (BFRL) In order to Justify future MILCON funding, ' 

A nuijor facet of the analysis. was £he calculation of 
facilities utilization considering the projected future 
studeht demands. To facilitate the subst^tlal amount of 
data manlpulatlj|>n required, a special course and facilities 
file were establlshied to reflect future student loads and 
classroom, lab, land training availabilities. The activity 
was provided with a report showing the projected utilization 
^ of 'each classroom, lab, and trainer. 

Another activity in the beginning phases o£ a BFRL input 
requested a report of basic course data; length, loads, * 
student/iWructbr ratlo^^ course hour iB, etc. This report 
was provl<|i^ to.piersonn^i responsible for facilities planning, 

A number of requests were made for specialized reports from 
the data base. Following is a list of the type of reports 
produce4 for one pr more departments. 



o 
9 

Q 
0 



Prlntld llstlkig of instructors byJNEC and by Rotate Date, 

PrlnteU rei|>ort of courses which had not been reviewed in 
the pa^t t^ years (1975 and 1976) , ' \ - 

LjLsted Icourses in which the no^show rate exceeded 10 percent. 

Listed IpG^urses where the demand exceeded capacity, A graphic 
report was also produced showing demand versus capacity 
on^ course and departmental basis, , 

A report! wap produced to show courses where capacity was 
«reat^ that 125 percent of demand, 

111 ' ' ■ 

Printed a report of courses where Historical utiliza- 
tion (0f paipaclty) was less than 50 perciknt « 

A repo|rt WaJ^ generateid to show data inconsistencies 
betweei:i Jt1|e length in calendar days and thc^„ total 

.coursfi iil^fsi based upon the curriculum outline. 



Jnent, 



AOB'b weTe\calculatedr«tid listed by course, depar 
and activity, 

Nufflwous baseline ranis were made using the model and prqjrlded 
to, eich departmeiit (or division),. ' These were multi-level runs 
by coufii^, divisilpn, department, and activity. No specific data 
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base changes, were made torespond to ''what If" requests, however, 
situations to wl^ich the TI% could be applied were discussed. 

i w 

Unfortunately, it was not possible to mal^eycomparlsdhs with resul<:s of the 
manually performed exercises since the effects of these exercises were not 
clearly defined other than In general terms; e.g., there will bb a severe 
degradation in training quality, etc This subject will be discussed in 
greater detail in the concluding section of this report. 

DEFINE USABILITY ENHANCEMENTS 

The following list represents capabilities beyond those of the existing 
models whlcfh were menti^ed at. briefings or during interviews. They 
suggest either enhancei^^iits (e) to the existing system or additional model- 
ing (m) efforts. The list is generally ordered based upon the frequency 
which items were suggested. Items 1. and 1Z. were, by far, the most frequent* 
ly mentioned. 

■ * ■ 

1. Develop program for scheduling required class convenlngs for 
effective application of ins true tor /facility/ training 
resources, (m) 

2. Incorporate support actlyltles and support personnel workload 
requirements into SCRR manpower equations; e.g., course review 
and revision. Instructor training, traiiier maintenance, supply, 
fleet-levied workload, admlnlstrl&tive, supervisory, etc. (e) 

3. Incorporat^e dynamics of Instructor rotatloni Instructor train- ^ 
ing, and instructor quallflcatltn cycle into SCRR model evalua- 

^' tlon and optimization process, (e) » . * 

, ■' • \ 

4. Develop model which can evaluate effects of specific decrement 
drills involving either personnel or dollar resources, with an 
Inherent priority assignment to these resources for automatically 
handling percentage type cuts, (m) ^ 

5. Develop model wfilch can evaluate resource implications from ' / 
workload restructuring, reorganization, *etc. ;. e.g. , centralization 
of course development activity, consolidation of tra4idLng aids 
development, departmental reorganization and consolldktlan, etc. ( 

6. Provide" capabilityo to define Instructor availability td the SCRR 
model on an individual basis considering total annual' availability 
less time assigned to non-podium (support) activities, (e) 

7. Provide alternate capability for SCRR model to eyaluate training , 
capacity based ,upon allowance (or approved billets) in addition 

to actual manning. Also^ provide ablldl^ty for *speclfylng^a 
mannlii level' from the NMP (Navy Ma^iniiag f Ian) by rate/grade to 
adjust the available resource Inputted to the model, (e) 

^8. Providers data base' flag to indicate whether an Instructor 
was filling an approved \I-Blllet (as opposed to teaching 
fron^ome other billet; ^g., CO, XO, malntenance\^ etc.) (e) 
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9. Data base should be expanded tip Include five fiscal years of 
data upon which models could operate, (e) 

l(j). Data base should be expanded to Include more than a tlHEC and 
I SNEC for Instructors; fields for flveJNEC's would be desirable.^ 
Also, this field should be designated for either NEC's or 
NbBC*s as well as designator codes for officers, (e) . ' 

11. Data ha^e should be expanded to Include Instructor time report- 
ing data\ which Is completed weekly by Instructors, (e) 

i ■ . 

12. Modify resource algorithms, for team tralxtLng and. for the use of 
mockups; e.g*, mockupT utilization may vary as a function oj& c^ 

. size as well a^ class days, (e) ^ ^ 

13. Modify CANTRAC data base to Incorporate PQS sections* automatl-^^ 
cally signed off as a result of successful course completion, (m)^ 

14. Maintain a data base of current refe^rence materials related to 
each' course. . (m) . 

15. Data base should Include an Id'entlflcation of which resource 
limits the normal capacity figure; e.g., CAP 1, CAP 2/ and 
CAP 3 migh$ be limited due to equipment, instructors, or space. ( 

16 . Data base should Include definitions of the meanlngd for terms 
used within the data base, or for input aiid output data elements 

\foT the models; e.g., LEN 1, LEN 2, LEN 3 specify the course 

length in calendar d^ys, etc.. (e) , . x ' 

/ '' ' ' ■ . . • 

,17. Data base should Include sufficient historical summaxy data 

from which time series analysis of trlnds and cyclic variations 
could be performed, (e) ^ <. ; 

. ' ■ ' ' * ' ' V ■ ' 4 

18. Incorporate cost factors fi;pm Mechanized Course Cost System ^ 
and refine cost attached to equipment to more accurately ^reflect 
true costs of installing, operating, and maintaining it., (e) 

19. Develop model to more accurately predict demand for fleet type 
courses, (m) 

20. Develop' a model for optimizing the number ^f course convenlngs 
versus the individual t lass size; e^gf.; is it more optimal 
(from a need versiis resource standpoint) to schedule one class 
of twenty students. or five classes of four students? . (m) * 

A frequen|^ concern which should be coxisid|pred an enhancement proposal was 
for the data base maintenance. /Each oS the activities believed that .the 
maintenance of . the data base would be a substantial workload and that t^hey 
cbuld not tolerate another separate update requirement similar to NITRAS. * 
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1. Hal^teiutnee, procedures. 




^ A prelliBliuiry analysis vas made as to the proposed enhanjH^S which 
should be studied In greater detail. They are as follow^^A * ^> 

2. tneorporatlon of billet data Into the data b,ase. ^ . 

3. Identification of tlms by Instructor for thf varlous^^^:^^ 
vorklbiid categories . ' j 

■ . . ; V. / ^ ■ 

4* Data base modifications; e.g., additional NEC fldldij. etc. 
REVIEW BY EVALUATION TEAM > ' " 

. . ■ ' ■ Cy" ■. > 

The major objective of the field test, was to reach ft decision rftgfttdlng 
the usefulness of the DOTS models (SCRR and TFF) to|Navy training managers., 
Review^ meetings with key personnel from each activity were acl^^^^ / 
2 and 3 March. These were Individual meetings conducted by TAE^at - / 
' which a presentation was made by IBM on the f leld ^fept raa»»^t8 . , : 

COLLiCTlON AND ANALYSIS OE FIELD TEST DATA. The prl^i^ Input to the 
field test results was a questionnaire completed byltwenty-f ive CdliiRAPAC 
and activity staff personnel and department/division heads^. Th^ 
of thft questionnaire was to IdentllEy existing and potential workload In 
the areas /where the DOTS models and data base might ibe oi assistance. A 
separate questionnaire sheet was prepared for each 9! the nine previously ' 
Identified I'Poteiftiftl Modellng/Datft Base Appllcatloiip.V The questloiuiaire 
formats ar%-shown: In. i^pendix C. ' ■ ■/'^ ' If^. 

The questionnaires wi^re Sunnarlzed tb gihow^ the manhbiirs emended on each 
potential appllcatloia by activity (Including COMTRAPAC). The. results of- * 
this sumnarlsatlon are shown In Table 2 . " * 

• ' , ..... , \f . , ; , - . , / _ U : ,• .) ;,■ , - ■ ■:. ' 

It was recognized thftt not tfanhours Identified agftlns tt^^ ftppllcft- 
tlons could be saved by use of the models, therefore ^the following 
"Savings Rationale/Assumptions" were mad*, and are the Mjiis^f«>r the 
figures In the CCKI^AC Activities MiiUiour Suomajry dlspla;j^ed in Table 2. 

1. jFlfty perceati of the Idefitlfled effort was assoiMlatad With 
r^cOll|ictlng; and manipulating dftta on the probltfi^^^^^ 



2. 



3. 



4. 



The remaining SO percent of the time wfts 4evoted tb) human 
. ana^slft,:i^dr cbrres^ 

The mbdels^and data Ibiase coul4 iMtve the time assoclatftd with > 
dftta collcH^tlc^ and lunipu ; 

Additionally , where the manhours Idehtlfled appeared to "ref lect 
a misinterpretation of - the application, the hours were adjusted 
before applying the pi^ecedlnig a|sumptloB^. 



■ir 
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TABLE 2. COM^RAPAG ACTlHaTlES MANROURS SUMMARY i 




I* A 



APPLICATION 


CO)fiBAFA( 


4 il&Mf 


PITCPAC 


rNWTGP 


: yCDSTCP 1 ' PTG 


TOTATl 


PERSONNEL 
REDACTIONS 


"•75 


656,, 


. / ■ ''-^ 
240 


185 ' 






i.TdJi 


. TRAINIlfG LOAD 
CHANGE ' 

- . . . » 


* • 

120 


5,872 




f 137, ■ 


988 






iNSTRUGim 

requxrem^ 

ASSESI^l^^ 


0 


296 


0 

'V 


50 


132 


58 


■/■ 

c . 

S36> 


mcON/BFRL 
/(N)a,Y$IS 


■ . f 
60 


1,160 




0 


• 


■ ,512 


98?. ■ 


JRAINER 
UTILIZATION 


0 ^ 


196 


• ■ ■ • 

? 0 


0 


786',|' 




DATA 

CALCULATIONS 

- * . 


,0 


1»226 




%070 


40 


* 3]p 


4.103 


QUOTA 
CONTROL 


48 

•> 




0 


96 


103 


94B * 


1,188 


DATA BASE .. 
EXCEPTION 
REPORTING - 


250 


.^00 

>< 


0 


' 96 


494 ^' 


44 


1,284 


EQUlPkENT 
CONSTRAINT 
ANALYSIS . 


0 


: 26^ 


0 • 


0 


362 ■ ; 


' * 90 


71^ 


^DITIONAL" 
A^PLXCATIQNS V 


d 


- 520 


0 


0 ' 


O-/ 


• 0 


520 


, TOTAL . 


553 " 


ld»588 


750 


2.534^ 


■ : \ ■ - 

^3,515 


^i 324 ^- 


!0,264' * 

,-f 
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/xhe total questionnaire results including benefits and comments, as well 
as field test ba Aground Information was presented to each activity. A 
copy of the complete presentation Is reproduced in Appendix D. 

POSITION STAffiMENTS AND DECISION BASED ON FIELD TEST RESULTS. / Bach of 
the activities were formally requested to prepare a position statement 
regarding the usefulness of the DOTS models and data base to the manage- 
ment of their activity. Comments, qualifications, and reconwendations ' 
were to be incorporated into the position statement. A representative 
sample from the position inputs is pkraphrased below. 



DOTS mode9.s as they presently exlstare deficient in several ways. 

o ' No NITRAS Interface is established for updating the data 
base. 

a...^^^^JKjt:^uts from DOTS models are subject to misinterpretation, 
especially since instructor support time categories are 
' iaot identified. 

o The models do not address either cost or student related 
problems. ) ^ 

' >* ^ %. 

^ o Solutions are based upon onboard personnel rather than 

^ billets. ^ ^ ' 

\ Incorporation of recomn^dedi enhancements to correct identified ' 
deficiencies 0oulid make DOTS models useful as managemenr tools, 
• however, the ekf:ent to whi^h they would assist the management of ^ 
. \ ' ttaining cannot be determined at this tln^ and will require further 
evaltiation. 

It Is recommended that liaisoj/be maintained with the dctiyity..to - 
define modifications and to dMermlne thcTactent to which Viable 
models can be applied • - Activities, hmrever, are more absorjbed la 
day-to-day operational situations rather thu longer ratkge planning, 
therefore, a more palatable system would be one which aided the 
solution of these types of txalnlngjnanagement probleiii. i ^ 
^ «* . < 

No clear basis for a decision to continue toward Implemeritat ion •appears 
from an analysis of the poslti^ statements. They do, however, suggest 
the necrd for: / 

1. Modifying the models and data base to incorporate suggested ^ ' 
enhancements. ( ^ . 

*■ . , *■ 

■ 2. Continuing the evaluation once tHe enhiuicements are added " 
, until a firm decision , can be reached. 

Therefore^ a further analysis of the. proposed changes is being made. 
Certain ones of these will be 'incrafporated duriijg the March through June 
period. -CQHTRAPAC and activity personnel will, be trained i^the use of 

20 
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the nodela, d«t/ b«f©, and sMlntenance procedures In. June and July, The 
decision to proceed beyond that point wlU be aade In^JyXy 1976. , \ 



I 



1 



— ' 
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^ SECTION III 
CONCLUsloNS AND RECOMMENDATIONS 



This section of jbhe report addresses the application of models within 
Navy trailing In the context of the system characteristics » especially 
those that are relevant to the successful (or unsuccessful) use of « 
models. Some general observations of the system features are Initially 
presented; this .Is followed by a discussion of their effebts upon the 
aipllcatlon^f models. Conclusions from the foregone analysis are sum- 
• marlzed and are followed by a series of recomaendatlons for improving 
the usefulness of management science techniques; e«g.» modeling* to 
Navy training manag^ent, 

CONCLUSIONS " 

GENERAL OBSERVATIONS 0^ TRAINXNG SYSTEM., The training system Is a 
subsystem within a much^ larger and rather rigidly structured system 
the military. The ability of the training system to plan and operate ^ 
is directly influenced by several features of this larger system, prlm^iirlly 
by the personnel plannlngyand operating characteristics as well as by the 
resource management system. Also, a major driver of the manner in which 
training is managed is the\ continuing congressional scrutiny of operations 
and resources. The view at\the operating level that resources will always 
be taken away when not needed, but rarely returned to handle additional 
workload, leads training managers to be highly protective of the resources 
they presently have. Some of \ the mote specific characteristics of the 
personnel and .resource systems which affect the management of training 
can be sunmarlzed as follows. f 

Personnel System Influences. The Navy exists in a state of readiness 

prepared to engage in military action if required. Thus, the personnel 

system is designed to ensure that qualified people are available to 

operate, maintain, and support a variety of naval weapons systems. 

To conserve the supply of technical skills, a balance must be maintained 

between the number of reenllstees, the numbers of personnel qontiiming 

to gain experience in their skill on the Job, and those being trained 

or retrained in a skill .category. To meet all of these demands, personnel 

must be rotated on a periodic basis between fleet and shore assignments • s 

Thus training officers, while, generally experienced to^command, do not 

^ normally have experience in managing in the terms connoted by 'management • 

Vithln the industrial sector. This comparison does not imply that manage-^ 
ment in these two environments |j|»;uld be exactly the same; however, there 
are basic principles which shoulP,be applied by managers, whether in the 
military or in Industry. 

One of the principles applicable to either sector is' the effective and ' 
efficient use of resources. The jnllltary training officer, however, is 
faced with somewhat of a paradox. On one hand he is taught the importance 
^ of readlnesii which promotes the maintenance of resources in a standby 

\ mode <Just in case \they-may be needed); on the otl\er hand, the accepted 

management approach in the industrial sector would be to control the 

i level of resource consistent with varying requirements. Considering the 

■ ^ - r 

" ; ". • , " . 
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relative rigldness of the personnel system^ and the attendant difficulty 
It presents the training manager In Increasing staff size (or sometimes 
In even getting personnel to fill existing billets) » It Is proper to 
question whether application of the management principle under discussion 
would Inprovai^^ overall management effectiveness. 

Resource Managonent System. As a governmental serylce function without 
profit Incentive, there appears to be little motivation to reduce expenses 
except as necessary to acli(^eve the budgeted amount. Pure cost reduction 
Initiatives as ml^ght exist In the Industrial sector for Increasing 
profits do not appear to be Important factors In managing training, 
especially at the operating level. The prlmar^j^obj active seems to be to 
spend up to (as dose as possible) but- not over the budget. 

Another rigidity In the resource system stems from the different approprl-*^^ 
atlons (e.g., 0 & MN, MPN, OPN, etc.) and the relative InablUty of 
training managers to make tradeoff s between them. A major question, as 
with respect to the peraoionel system^ Is whether managers could be more 
effective If they gave up resources when they were not needed and then 
battled to regain tliem t^hen a new need arises. 

s 

Plahnlns^' System. The major focus of of much of the planning activity 
appears to be on the week to week scheduling of Instructor and facility 
resources made necessary by fluctuating Input lev^s. Considerable 
emphasis Is placed on reacting to fleet ^operational requirements and 
planning for contingencies Is hampered by a variety of factors most 
majoif of which Is a decided lack of a consistent, timely and accurate 
data base from which sound planning can take place. The characteristics 
of the plan data necessary to support external requirements channel the 
limited planning assets available Into production of numerical data. 
Consequently, most activities are unable to establish planning as a 
process promoting awareness of potential future problems so that they 
can be handled more effectively If and when they occur. 

From observing*" training planning at the tra^lnlng operations level » It ^ 
appears that good planning will be accomplished only If 1) It Is required, 
and 2) there Is some benefit to the planner; e.g.. It reduces his overall 
workload or helps him avoid future problems. 

PROBLEMS IN THE. APPLICATION OF MODELS TO NAVY TRAINING. Models by th^lr 
very nature require a fairly well definable system operating with some / 
egree of consistency. If the system consistently deviates from normal / 
pVactlces, real data used to drive the model may produce *^nolse" msklng ^ 
Interpretation of output data difficult or potentially mi^l^adlng. 
Deviation In t)x±s context refers tetany practices that ave^potf or 
cannot, be Included In the model logic. [ ' 

For a model to effectively help the training manager. It must: 

Tell him something he doesn't knpw or cannot pinpoint. 

Justify his assumed^osltlon; e.g., the department Is short 6f 
^sources. 



'ErJc 
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Prod^cie output in « f ora that can be easily used to support: 
a paYWctilar position.^ « 

Be manpower and cost effective. 

Be accurate. * ' 



So for models to be applied effectively to the management of naval training* 
they must have technical validity. That Is, they must project a reasonable 
picture of the system, as an output, given accurate data on the systiem as 
Input. Also, when system variables are changed, the corresponding changes 
In output should again project a reasonable picture of the ^actual system 
In ItSf changed state. , , . 



But technical validity Is only one of the re'^ulrements for effective 
use o£ models. Another major requirement relates to the motivation ' 
of the model users. They must recognize some benefit from using 
models, and these benefits must outweigh the post a and other liabilities. 
This motivation 'may be lacking for a nikber of reasons, for exampler 

' ■ . ■ ■ • 

• 0 The .model output does not depict conditions as they 

actually exist, either because-the Input data are not 
accurate, the processing logic Is In etror (this Is a 
problem In \ technical validity), the output picture Is 
Incomplete, or the output Is subject to mlslnterpreta- 
i tlon. . . 

• . 

o The model output Is accurate ^nt exposes aspects of the 
. system operation which are not consistent with the 

manager's view (or the view he projects to hlgheft levels 
of connuind) . 

o The model output does not reveal new Information on which 

Improved decisions couijLd b^ made. ^ 
■ ' ■ ■ ^ ' ' • - . 

o The model projects condition^ beyond the operational and 
planning period of Interest to Jthe manager. 

Even If "model outputs could project » reasonably valid and useful view * 
of training conditions, there' may be little motivation for the training 
manager to structure a "what If" situation (modify the npcessary Input 
variables) for running the model. . 

One of the condltlonis mentioned for valid model output 1b accurate 
Input, This generally Implies that a data base be maintained -with 
relatively; current Information. Data base malnteniiiice can result . 
In a substantial wdfkload for training staffs. Navy titalnlng is 
presently Implementing NITRAS which requires a significant maintenance 
workload at the activity level (at least in relation to the" perceived 
benefits), tt Is hot reasonable to expedt activities to duplicate 
inputs, in order to maintain separate data bases. The activity S^iould 
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view data inputing and data maintenance of mtdtiple data baies as an 
^ntegj^ated system where any data element residing In more than one * 
data base is defined only once at the activity leyel. The propagation 
of dau to multiple dafia bases should be transparent to the user at 

the activity level. ' ^ ^ 

' • ■, . .. . 

SUMMARY CONCLUSIONS ON THE ^APPLICATION OF MODELS IN THE NAVAL EDUCATION * 
AND TRAINING ENVIRONMENT. The cqnclusions reached as a result of the 
field test at COMPTRAPAC are, in general, consistent with those identified 
in prior evaluations of the use of models within naval training attivlties. 

1. The present naval training system is influenced, and " . 
essentially driven, by external ays tans ove^r which it hai? 
little or no control. It therefor^ musit operate within ' 
the constraints of those systems; namely, the personnel 

aind resource management systems. 

2. Training managers have little motivation to manage 
resources up and down In relation to requirements 
because* of the rigidities imposed by these exteirnal 
systems. The primary operational objeetive appears to be 
to maintain a level input .and thus a steady resource level. 
There are many techniques available for accomplishing this 

, at the present time. 

3. Models^ and especially aata bases, whicbuwould be .available 
to all command levels are viewed as a tfbreat by the training 
center levels since they may be used to ^'squeeze out'* excess 
resources without the corresponding benefit of Justifying 
additional resources when required 

4. The most beneficial types of data processing support at the^ 
activity level can be categorized as follows: 

■ ^ ■ - " 

o Schedulipig tools which facilitate optimizing 
the use of resources; namely, instructors and 
facilities. . 

* o Locally accessible data bases and conq[>utational 

programs which permit rapid assessment of 
..resource requirements with changing input demand, 

5. A system of models in order to be effective requires a closer 
coupling. between the varipus command levels. This coupling 
must promote a willingness l:o interaldocate resources within 
a functional command permitting variations in ;resources, both 
up atid down, at the activity level. Models, then, would be 
used to justify new and existing reia^ource requirements at the 
activity and functional command levels, atld would promote 

a mote equitable distribution o^ those resources. 

^ there are some indications that the management change 
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required for the etftctive use of iqodels 1^ occurring 
*ln an evolutionary way « One evidence of this la the 
nwnning of activities to meet recuKr^^^ 
with an Incteaalng tendency to shar* resources for peal^ / 
deouinds.: Because of this trendy there is a reasonable 
expectation that models, would receive an objective evalua-- 
tlon at the functional command levi^l^ with a goo^ chance 
of a positive evaluation regarding their irtljtlty* \ 

RECOMHENDATIONS ' 3 V 



The major recommendations based upon the preceding conclusions are: 




1. Identified enhancem^ents be incorporated • ^ 

^ V ' \ ^ 

2. Activities Should identify km personnel to\lnterface with . 
the DOTS nodela/data base system to: 

a. ' structure inquiries' V \ 

b. perform data base maintenance 

3. COMIRAPAC should identify a- key ii^lvlduai who will bejreWpon- 
slble for; V \ 



a. Inpu ting data base changes ^o NCSS 

b. ensuring data Integrity 
c*. Controlling changes 



d« performing all SAMIS functions necessary tcPTecoup 
from data or program errots 



ry tcKTc 




e. identifying and programm:|fng R/^S reports 

for COMIRAPAC and Its activities " <> 

4. Train activity and COMTRA&AC personnel Identified above to the 
level required to perform their defined functlbna. 

5. Additionally, train Logistics attd Plans Division personnel Itji 
operatlbn's, use, and capabilities of. the models for appllcas-/ 
tlon at the functional connmnd level, ., , . / 

6. Conduct additional model/data base evaluation at the \ / 

COmAPAG level, speciiieally with the Logistics and Elans 
Divlsloii. • 



?♦ Obtain strong CNEt support for the identified applications of 
^modila at the functional comnand level, and for the management 
^philosophies require* for their effective use. Without thisV 
ifupport* there is. little likellliood thit inodels will be effec- 
tively applied within the trait^iiig conman^ * • 



APPENDIX A 





MEETINGS ATTENDEES 




• , ' \ '. 


8 January 1976 *^ 


COMTRAPAC 




NAME 


■■■4 

RANK 


COMMAND 


telephone 


M.-^R./ WASHBURN- 


CIV 

T 


FLETRACEN 


2^5-1611 


J. P, CROWDER, JR 


CDR 


FASWTCP 


: 225-3301 


B. a. SMITH 


CDR 


FITCPAC ' 


225-3326 


n% A.. SANSOUCY . 


CIV 


FITCPAC 


225-3326 


MiryB; ORBANN V 
W. G. Y6UNG 


- LTJG 
LCDR 


f;letracen > 

NWT6P * V 


.235-l^li ^ 
' 437-7576 


P. J. SHELDON • 


LTJG 


•NWTGP 


437-5026 


C. KELLOGG 


LTJG . 


nWtgp 


437-7557 


* 

D. PLUNNECKE 


LCDR ^ 


COMIRAPAC 


225-4556 


A. G. ROACH 


LCDR 7 


FASWTCP 


' 225-4400 


A. F. ROBB ^ 


STCS 


FASWTCP 


225-3310 


M. H. LEPICK 


LT 


FASWTCP . 

» 


.225-4400 


R. C. AliBRlGBT 


LCDR 


FASWTCP 


22V3316 


J. R. BRIANT 


CIV 




225-4219 • 


F. He CURLEY 


1* 

CIV 

■ : * ■ • ^ - 


NWTGP 


437-7569' 


P. CURRY , 


■ ■ ■ 


COMTRAPAC 


225-4219 


C. J, MICHAEL 


LTJG 


COMTRAPAC 


225-4219 


N. WALLACE y 


CIV 


NATIONAL CSS 


286-9635 


R. E. HC cpiCHEON 


CIV 


FCDSTCP 


225-6334 



35 



29 



Gv p. liELLQCk^ ' 
RV 1. HALPIAN 
E. laCHOI. • 
M. 6* MIDDLETON 

H. M. WINFREY 
R. P. TOET![CHER 
J. D. DEHLER 
^, MC CURLEY 
R. E. POWELL 
C, WAGi;; 
W,G. YOUNG 



LT JG 

CIV (IBM) 
LT 

CIV. (TAEG) 

CDR ; 
MAJ° 
CDR 
CIV 
LCDR 
CDR 
LCDR 



. CODE 

pi 



^ ■ 



1 40 

50 
70 
50 
14 
30 
60 
10 



21 Janumry il976 - PLETRACEN 



. 'TELEPHONE 
- 437-7,566 
437-7557 
305-783-0043 

■ • ' * 

437-7274 

305-646-5198 
AV-i791r5l98 

437-5954 

437-5954 

s 437-7553 

437-7569 

437-7571 

437-7554 

437-7567 



BRUCiQfER, J. W. - 


LCDIC 




' 50 




235-1637 


rBAILEY, P. E. 


LCDR 




10 




235-1601 


GUITERREZ, Z. R. 


CWOr-3 




11 




235-1621 


STURVIST, G. H. 


^ LCDR 




05 




235-1641 


PIKE, D. 


LTJG 




06 




235-1660 


OTTO, V. P. 


PTCM 




42 




235-1524 


ORBANN, H. 6. 


LTJG 




021 




235-1611 


SMITH, P. D. 


> CpR 




20 




235-2361 


GALLAGHER, T. M. 


LCDR 




40 


■ » . 


235-1661 


BRIGGS, L. J. 


LTJG 




21 




235-2634 


HAMMOND, T, J. 


LCDR 




\ ' 30 ■ 




235-2634 


RUCH, M.(XO) 


CDR 




I -- . 




235-1601 


SHBMANSi:!, Vi. B.(CO) CAPT . ' 


■ V- 


.00 




* 235-1601 



22 January 1976 - FASNTCI 




MAME -RANK 
H. 6. WENZEL (CO) GAP! 
L. E. MEHCH (XO) ■ CDR 
F.' R. JOHNS 
P. M. FAGAN 
D. D. THOMSON ' 
Di F. WALSH 

J. P. CRONDER, JR. CDR 
R. C. ALBRIGHT LCDR 
A^ F. ROBB 
L. M. WHITE 
M; H. LEPICK 
A. G. ROACH 
R.. CLAUSEN 
M. ,A. SKUBINNA 



CODE 
00 

■ <^01 
02 

» 

02b' 
\23 . 
25 
03 
30 
30a) 
30B 
31A 
31 
22 
06 



TELEPHONE 

225-3303 

225-3303 

225^3305 

225-4413 

225-4411 

225-4412 

225-3301 

225-3310 

225-3310 

225-3310 

22>;^4400 

225-5134 

225-441&- 

225-5311 



B. G. SMITH <C0) 
H. A. SANSOUCY- 



22 January 1976 - FITCPAC 



225-3326 
225-3326 



37\ 



31 



23 January 1976 - FCP3TCP 



NAME 
R. tie 
6. E. 
R. M. 
D , 

J. W. 
W. C. 
6. 6. 

B. A. 
W. E. 



qUTCHEON 

DENNi JR. 

GABRYELSia 

SCHWARTZ 

CASHIN 

DUNHAM 

LOSLI ' 

WHITEHEAD 

MAC DONALD 

SMITH 



RANK 
CIV 
LCDR 
LCDR 

xcdr! 



CDR 
LT 

LT 

s 

CDR 

OSes 



CODE 
OOEl 
35 
• 33 
34 
41 
03 
37 

32 
4U 



TELEPHONE 
225-6331 
225r'6263 
225-7S11 
225-^6529 
>225-7654 
:-«25W34 
225-6374 
225-7635 
225-7347 1 
225-7017 




. --TV 



32 



38 



S DAtA BLWiT I)EFIiaTIONS^ 



CiOURSE 




BCAF 1 



DMD 1 



BDMD'l 



OFST 
PFAIL 



■■ ■ >■ s,; 



DEFINITION 



^ A16 



liH(.)N 



NNN 



NNimN 



N(.)MNN 



The ObP code Is tt^e Wlqiie A ppsltlon 
alpMxmMirip for each 

CQUue taught the Navy' (from l^TRAS) . 

/ piXf$ ±B the 10^ position alphabumerlc 
CIN code used* In the Catalog of Navy 

^ ^ Xraininig Corses , (CANTRAC) . This code 
is iden^l^a^^^^^ same course taught 

a^^ dilf eirra /X^tom NITRAS) • ^ 



Thiii is the 1^ charac^ name of thj& 
course'' (Activity Shbrt .Name from NITi(AS)« 



^Thls 



is. the arJ^ 



number of convenlngs 



for the course, planned for the Current 
• ' fiscal year (from NITRAS) . 

Thls^ Is tihe lei^gt\i In days ' Including ^ 
> weekend daysy of *the course 'for the '^^^ 
current fiscal yaar (fr€)iOS[ITRAS) . / ' ^ ; 

..... ^ ./ \ - ' / '^''V'-v'' 



lurrent limiting, capacity (normal 
capacity) for the coutse. ^ This li 



Is th( 



lesser of the. immbers-for PERSONNEL ^ 
'^BQUIPfflWr; and^PACB from NITRAS/ I 

this la the^cui^rent^iiumber of ^ seats In 
thf course alUocated to SUPERS or other^ 
agencies and%ot available for I0C4I 
quota control) (locally obtained). 

This ^ the current total anticipated 
annual, demand for the course (from 
NITRAS) . ' 

^Thls isl the current annual flemand f o^ 
^^e cdurse for students detailed by 
gvand other agencies (locally 
. obtained) . J/ * 

^ Leave blank. u * ' 

Thla Is the current historical (last 
12 months) failure rate for the course 
(from NITRAS) . " ^ ^ \ r\ 




9 

RjC 



34 



NADIS 



»0 SHOW hCOhmn * 



BXL6 



mm 



CODRSE CARD 2 (Enter 2 In Coilim 80) 

-1 \ CDP . /, . AAM V ' 
CONV 2 NNN 
Uni 2 NN(*)N 
GAP 2 3^NNN " 

BCAP 2 NNN ^ . 

. DMD 2 NNNNN 
BDMD^2 MNN 

1 CHftlC 2 ■ / *" v^" 

CONV 3 MN(,)N 



VIEN 3 



NN(.)N 



NMN 



BCAP 3 NHN 
A DMD 3 NNMMM 



B]DIID 3 
'^HK3 



mm 



J- 



Thlt If the hletoirlcel (Xeet 12 nonthe) 
^non-icedealc dleenrolOaent r«te for- 
the CQucie (£ro« NITRAS). \ . 

Thii'ii tke hlf torlcil (last 12 aonth*) 
no<-show rate experienced by. the coutrie. 
Thlt rate la deternlned as the percent- 
age of thoae scheduled for the course 
that did not attend or cancel (locally 
Qbtalne^jjl \, 

This Is the historical (last 12 months) 
aet back rate for. the course (from 
NITRAS). 

' This is tlie leng^ in weeks that a 
student must wait for a local quota 
for a courae (locally obtained), / 

Leave b>an]p. * ■ 

? Same aa CDP on Card 1. 
Same aa CONV 1 on Card 1 but for FY77i 
Same aS LEN 1 on Card 1 but for Fy77. 
Same aa CAP 1 on Card 1 but for FTf77. 
Same as SCAP 1 on Card 1 but for Fr77. 
Same as,«fl) 1 ori Card 1 but for PY77. * 
Samp aa BDMD 1 on Card 1 but for PY77. 
iWe blank. 

same aa <:^NV 1 on Card 1 but for Fi78. 
Same as LEN 1 on Card 1 but for FY78, 
Same as CAP 1 on Card 1 but for PY78. / 
Same as BCAP 1 on Card 1 but for lYJS. 
' Same as' fiMD 1 on C.ard l,but for Fy78-. 
Same aa BDMD 1 on Card 1 but fq^^78. 
Leave blank.' 
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PAOB 
.AVAIL 



GTOPE 



PNEC 



SCH 




y 



suic 



CODRSE CARD- 3 
CDP 
UCAP' 



FPJITY 
KDTE 



AA 

NNMN^ 
NAAA 



AAAAA 



AAAAVj' 
NMN 



YYIMDD 



Lcuiv* blank* I - 

This !■ th« allow«d or standurd failure 
rat*. Inter 0060 la abtence of bttter 
data^' 

Tljli Is the 2 digit course priority 
.ddd* (from NXTRAS) . » 



*Thls la the ^2 '^piitlon type code £o 
the course, (lete* flUett C, etcO 
(frbn IIITRAS) . 



This Is the prlntry NEC code for those 
courses granting NEQ U (f roA MITRAS) • 

The first portion (Co; 71) will be 
coded as follows: 



4 - NMTGP 

5 - FITCPAC • 

6 - FI^TRACEN 

7 - FCDSTCP 

8 - PASMTCP 



The remaining tturee positions (Cols 
72<*74) can be any alphanumiric designs-* 
tlon Identlfyltig the organlasatloital unit 
-^nto which the course Is to be grouped^ 
e^. r NAV. ^ ^ 

This la tlie Staff Unit Identification 
Code ^(frott NITRAS) . 



Sane as prior definitions for CDP. 

The ratio of the total number of 
students, enrolled. In the cotirse over 
a one year period^ to the annual class 
capacity. (Use fiscal year^- to ^ 
date data). . *% v 



Leave blank. 
Leave blank. 



This Is the date on whl9)ri:he course 
curricvLLum was last r^lewed (Review 
Bate). 




t 



H5ETB 



TIHSTER 



NM.N 



CCHM AAAAAAAAAA 
FACILITIES FILE LOAD CARD 

i 

SCH NAAA 

GDP AAAA ^ 

BLDG AAAAA 



BM 



RMCAP 



RMPT 



AAA 



NMN 



N 



REQHRS NNNN.N 



<i AVHRS 



mm 



INSTRUCTOR FILfi TYPE - 1 ~ CARD 



ID 

NME 

Hi 

RATE 



NNMNNNNNN 

♦ 

A16. 
AA 
AAAAA 

4-^ 



Leave blank. ' 

Thla la the total Instructor required 
number froa the Instructor Computation 
Form, 

GOMTRAPAC will complete thla field. 



S?e prior- definition. 

See prior definition. 

The rukwi^x number of the building In 
whrch a classroom or laboratory space 
Is located. 

' * 

The name or number of a classroom or 
laboratory spacel, 

' ^ ■ • . ' • r . . ' 

This l8 the nuinb^r of permanent aeat a ^ 
lab poaltlons^ trainer positions, etCa, 
Vhlch can be utilized by students. 

This Is the type of training for which 
the apace Is utilized and la coded as 
follows: 

1 - used for theory 

2 used for lab 

t 3 - used fox; theory and lab 
4 designates a trainer 

Required hours represent the number 4}f 
hours the Indicated space/ls required 
to convene ona^esslon of the referenced 
coursee ^ 

The nuniber of hours » on an annual basis i 
^th€^ space Is available for Instructional* 
purpoiiies* 



Social Security Number of Instructor 

.Instructor's last name, * 

Instructor's Initials * A- 

Instructor's rate o^f rank;^e.g., PNl 
or LCDii (left Justify). 



8CH 
MP 

SNEC 



TTMM 
« 

wm 
mm 



IHSTRUCTOa FILE TYPE - 2 - CAW) 



ID 

KHE 

IN 

SCH 

CDF 

TTL 
CTYP 

c 

ASN' 



NMNmiNNMN 

A16 

AA 
NAAA 
AAAA 



N 



QUAL 



SIR 



NNN 



NN.N 



CHRS 



NN.N 



Ste prior dtflnitidiif 

Thli If ttit ditft tht II^^trti^^^^^ 
rtportid on twatdf 

Thli li thi Isiatrtictor't pliimed 
rotation datt* « 

> • ^ ' <: '. ^ 
This ti the Xtuitrtictor*! Frtiitry NEC 
(If nont iMva blAsik) < 

Li ii the Instructor *• Secondary 
(if nonet leave blank)* 



See prlx>r definition* 

See prlok definition* 

See prior definition. 

See prior defXnltlon* • 

Enter CDF (one per line) for each 
couriie an Ihitruci^or la qualified 
to teachi 

Leave blank* 

Leave blank* 



Enter a 1 If the Instructor Is assigned 
to teach this course;, if the 

Instructor is qualifli^d but^s not 
assigned to teach. 

This is the percent:; e*g*r 090, that 
the instructor Is qualified to tieach. 

This is the student/instructor ratl\ 
.from the Instructor Coniputation Foina^ 
A CDF nay have^sidri; than one SIR; 
make one line entry per SIR. 

The numberl of insttuctlonal contact 
hours taught^ at a given ratio of 
trainees per instructor. A contact 
hour represents sixty minutes of 
instruction* This refers to clock 
Jhours of curriculum time devoted to 
actual instructiontNucc|ui9lve of 
breaks » admlnlstratiye tlmey lunch,* 
/ medical, dental, etc; 
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INSIRUCWOHSj 

1« The Fprn Coluan it i^ate^preted at followas 

A the field c«n contain W alphabetic or. ntmeric character. 
N - the field can only contain nuwerlc characters, 
- - lnaert| a daa^^ in this colua^ . y 
insert a deciaal point in thiVcpluan, 

\ (.)- this represents % assumed decinal position and is not 
^ written on the forn. 

. Ann - Eg. A16 - thJjS represents an alphanumeric field of nn 
positions eg. 136. ^ 

2. Left zeros need not be inserted. ^ 
■ ^ ' ■ . . " \ . ■ 

^ 3. When data are repeated from line to Une, Indicate with a 
wiggly line down the dolumnV 



4. Questions can be addressed to: 

Larry- Duffy - 225-4216/17 
Ron Yanko - 225-4216/17 



S, 



APPENDIX C 



FIELD, TEST QUESTIOHNAIRE SAMPLES 




L 



J 



i. 
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INFORMATIOir SHETOS 
■ , : FOR 
DoiQ MODELS/DATA BASE ^ 
COST/BENETIT AKALYSIS 



Attacicd are information sh««iti outiinincr nine p<a$«ntial 
applications for t:he DOTS'ModtXs and atsoclattd Dhta^ 
Th«s« ware identified in iiiterviewa of key COMTRA^IlC 
personnel by menbejrs of the DOTS development teas over 
past few weeks. An initial assessment of the utility o 
models and data Ibase will besmade from the infomjation 
on these information sheets « ' ^ 1^ 



Several additional blanJi; sleets are also provided for identi- 
fying applications hot obti^ined in the interviews. 

^ ■ : ■ : ■ . ■ . 

Please complete each of the sheets for your area of responsi- 
bility. • Department: l^eads should include *all efforts on a parti- 
cular application >pei,formed within thiilr department. Command 
level offices t e.g. ^tfraining Office, should rep<|rt only on their 
particular efforts, tiie Objective, however, is to qbtain a ^ 
complete picture of pdiEential applications at each activity^ 

The application categories; preViSisly identified are meant^o 
suggest broad evaluation ahd assessment workload requirements 
which may result from higher. level command regutists a or which 
may, be self generated i|^ pe:i^forming the planning and control 
function at your activity. If they suggest a similar applica- 
tion, that: can b^b clarified by providing additional comments. 
The reverse side of^he sheets can also be used to document:. 
additional detail."^ 

The completed sheets will be picked up by the DOTS personnel 
on Friday, February. 27th. They should be foi^warded to the 
DOTS liaison official at your activity prior to that time. 

If there are , any questions, DOTS^personnel (Mr. Ron Yanko 
and Mr. Larry^ Duffy) can be contiicted at 225-4219 or 
225-3619. . ■» • 




ivities 



Thank you for your cooperation itt providing this information. 



ZafotMtiM Shttt for soils Hodtl>/P<t» Cott/8«ntf iti ^Amlyilj 



AppliCAtlon iHv^iowly Idjintiflwl by COHTRAPAC Aetlvltiat)> ' 

, 1. Assm the tffects of. rtducing servlct training related 
Mnpoiter by some specific percenkagereg. 5 percent. 10 percent 
or 30 percent. 



Manhottrs/OecnMct 100 Mnhours tot«l| 5 ptoplt for 20 hours Mch| %tc.) 



I 



Task Typleai^y P«rf ora«d By (lee.i Offlewi Eiaiattd, Clvi;i«n) ' 



How Task Is IjrplcAUy P^f orsod (tegei nuiauallyi ptn tnd poneili calculator i 
bralaatomlogt atCe) . 



If Task is not currantly parformad» would it ba parformad If approprlata 
snathodf/ tools vara avallabla (If^t^ Is tha cassi plaasa projact aach of 
cha pravlous catagorlas) ^.^^^ 



Addltlooal CdMiatits: (optional) 



IpforaatdLon Shtat for DOtS Modals/Data B«»» C<igfcM«ttiftt> AniiWif 



t» AppXicttipn CPrevioufly Idtiitlfied by COMTRAPAC Activltflea) 

2. Assess capabilfty to handle an Inqreased training load for a • - 
specific course using existing instructor and facility resources; eg. 
GMT A-School load increases front 220 in FY 76 to 340 in FY 78. 

rr«(^cac7 6 ptr jnpntht 10 p«r year, etc,)*;; 



Hanhours/Ocoirence (e.g., 100 oanhSurs total, 5 people for 20 hour i each, etfe.) 



Taak Typically Perforaed By (i.e., Officer, Enlisted, Civilian) 



How Task is Typifcally Perforaed (e.g., manually, pen anV pencil, caicu'lator, 
bralnstormlngi etc.) ' 



If Task is not currently performed, would it be performed if -appropriate 
•ethods/tools were available (If this is the' case, please project ekchrf 
the previous categories) , " 



Additional Qooments: (optional) 



' 1 



taf0ffi»tlont Shift for POTS Modjla/Paf Baii do«t/B«n«flif Annlyiik 



Application (Prtvioui^ly id«ntl«ltd by COMTIt^AC Activities) 

9, Analyze equfpinent utntzatlon and constraint effects-4Pom varying 
team training demands and resulting queries. Determine sensitivity 
of throughput capability to different demands.^ 

' • . ■ . ■ ■ ' ■ ■ 

Frequency 6 per aonth, 10 p«r year, etc.) 



Manhoura/Occotence (e.g., 100 manhoura total, 5 people for 20/Koiir« ea</h» etc.) 



Teak Typically Performed By (I.e., Officer, Enlisted, mvlllan) 



How Task Is Typically Performed (e.g., manually, pen and pencil, calculator, 
brainstorming, etc.) 



If Task Is not curreftely performed, would It be performed If appropriate 
methodf /tools were available (If this is the case, please project each of 
the previous categories) 



Additional Cooaents: (optional) 



InfoviMtlon Shtst for DOTS Hod tli/Dat* Bait Cott/Benifti:* Afiilyifls 



I 



Application (Additional Itna not prtvloualy Idantlfl^d) 



Fraqucncy 1$ per month, 10 per year, etc*) 




Menhours/Occurence (e.k,, 100 nanhours totaitrS people for 20 hours each, etc.) 



Task Typically Performed By (I.e., Officer, Enlisted, Civilian) ^""^ 



How Task is Typically Performed (e#g., manually, pen and' pencil, caiculator, 
brainstorming, ett.) 



If Task Is not currently performed, would It be performed if appropriate 
methods/tools were available (If this is the case, please project each of 
the previous categorlee) 



Additional Comments: (optional) 
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. . FtELD TEST APPROACH 

8 0AN KICKOFF / > 

DATA COLLECTION AND PURIFICATION . > 

19-.23 JAN ACTIVITY BRIEFINGS - 1> 



DEPARTI1ENT/DIVISI0N INTERVIEWS AND DEMONSTRATIONS 
cb,ST/BENEFIXmYSIS INFORmTION QUtSTIONNAIRE^^^^^ 



COMTKAPAC/ACTIVITY UTILITY ASSESSMENT 




ERIC 



4 t'* 
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COWTRAPAC/ACTIVITY UTILITY ASSESSMENT ^ ^' 

' . ' ' • ■ ■ ' /, ■•■■' .\ 

• .NINE GENERAL APPLICATIONS IPENTIFIED DURING ACTIVITY 
INTERVIEWS \ 

QUESTIONNAIRE DEVELOrtD TO ASSESS EFFORT EXPENDED jON. 
EACH APPLICATION 

- FREQUENCY ^ , . ( ' 

- HANHOURS/OCCURKENCE . - 

- WHO DOES * , 
.-TECHNIQUE 

QUESTIONNAIRE RESULTS SUMMARIZED * 
. - ACTIVITY BY DEPARTMENT/DIVISION} ^ 

- COMTRAPAC BY ACTIVITY ' 
-"TOTAL BY APPLICATION 

KEt COMMENTS SUMMARIZED 



f I 



COliTRAPAC 'ACTIVITIES MANHOURS SUMMARY 



APPLICATION. 


COMTRAPAI 


:| Asw 


■ FITCPAC 


:[ NWTGP 


FCDsfcP 


1 


TOTAL 


RiKoUNNtLJ 

REDllCTIoi^ 


75 


^656 


2^0 


85 


350 


302 


1708 


TRAINING LOAD 


120 


I 5872 


.60 


I 137 - 


988 


60 


7237 


INSTRUCTOR 

REQUIREMENT 

ASSESSMENT 


' 0 


296 


0 


50 


• 

132 


58 


* 536 


Mii^rnM/DCDi 
rim,UN/DrKL 

ANALYSIS 


60 


1160 


0 


0 


260 


512 


* 1992 


TRATNPP 

UTILIZATION 


0. 1 


1^6 


0 . 




' 786 


Q 


982 


DATA 

CALCOUTIONS 


0 

' * 1 


1226 


i|50 


2070 


4o 


317 


i|103 


(JUUTA CQNTRQL 




0 


0 1 


96 


103 


9^1 


1188 


DATA BASE . 

EXCEPTION 

RFPORTTNfi 




i ' 


n 1 
u 1 








128^ 


EQUIPMENT > 
CONSTRAINT ^ 
ANALYSIS 


0 


262 


.0. 


0" 


362 


90 


71i| 


ADDITIONAL 
APPLICATIONS 


0' 


520 


0 


0 


0 


0 


520 


TOTAL - 


553 

1^ ^ I 


10 J 588 


750 




JJXJ 






< 




.% 


50 . 


\ 









iQ . A$W BENEFITS SUflflARY . : . . 

" JOTAL ANML APPLICATIONS - APPROX 300 

• TOTAL ANNUALMANHOURS - 10588 

• POTENTIAL riANPOWER SAVINGS FROM APPLYING ^MODELS/DATA 
BASE - 2.5 MEN ' ' 

V SAVINGS RATIONALE/ASSUMPTIONS 

- 50Z OF IDENTIFIED EFFORT DEVOTED TO,|DATA. COLLECTION 
AND MANIPULATION 

- SOX OF IDENTIFIED EFFORT DEVOTED TO ANALYSIS 

- DATA COLl£CTION AND -MANIPULATION TIME CAN BE SAVED 
USING liODELS/DATrBASE 

• ADDITIONAL COMMENTS 

- DEPARTMENT 06 NOT INCLUDED IN ANALYSIS 

- APPROX 50X OF TOTAL IDENTIFIED EFFORT IS APPLIED TO THE 
ANALYSIS OF TRAINING LOAD CHANGES « ^ 

' - ADDITIONAL APPLICATION ■iiENTIFIED TO USE DATA BASE 
INFORMATION TO COMPLETE CNET FORM 1500/8 " 
7 MI LCON/BFRL ANALYSIS AND DATA RECALCULATIONS ACCOUNT 
^ FOR'ABOUT 20% OF TOTAL IDENTIFIED TIME 
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. ASW COMMENTS SUMMARY 

PRESENT APPRdACH PRECLUDES THOROUGH ANALYSIS DUE TO TIGHT 
DEADLINES . j V 

, HARD COPY OUTPUT FROM ANALYSES MAY BE USED AS SUPPLEMENTS 
1-0 jJUSTIFICATIONS/ipRMATION 

BFRL PREPARATION COULD BE SIMPLIFIED IF FACILITY LOADING ^ 
COMPUTERIZED 

IMPROVED ACCURACY/REDUCED RESPONSE JIME/REDUCED TOTAL 
. EFFORT WOULD RESULT FROM MODEL/DATA BASE USAGE ■ 

4 
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FTC BENEfflTS SUMMARY 



TOTAL ANNUAL APPLICATIONS • - APPROX 225 



TOTAL ANNUAL M^NHOURS - 2324 



POTBiTIAL MANPOWER SAVINGS FROM APPLYING MODELS/DATA . 
BASE 7 A MAN ' • ' ' 

SAVINGS RATIONALE/ASSUMPTIONS . 

- ABOUT 50% OF MANHOUR ESTIMATES APPEAR ^TO DEAL WITH 

STUDENT ORIENTED PROBLEMS AND WERE ELIMINATED FROM 
THE COST/BENEFITS ANALYSIS 

- 5QZ OF IDENTIFIED EFFORT DEVOTED TO DATA COLLECTION 
AND MANIPULATION 

- 50% OF IDENTIFIfD EFFORT DEVOTED TO ANALYSIS 

- DATA COLLECTION AND MANIPULATION TIME "CAN BE SAVED 
USING MODELS/DATA BASE , J 

ADDITIONAL COMMENTS 

- HALF OF DEPARTMENTS INPUniNG INDICATED NO INVOLVEMENT; 
WITH IDENTIFIED APPLICATIONS PROBABLY DUE TO A PREJUDGMENT 
OF DOTS APPLICABILITY 

.' 53 ' ' . 



FTC COWftENTS SUIWRY 
SOLUTIONS TO PROBLEMS ARE RELATIVELY OBVIOUS 

■ * . • ' ■ ♦ '' 

• NOT NECESSARY TO USE COMPUTERS TO PERFORM 

QUALITY OF TRAINING NOT ABDRESSED BY MODELS 

DOTS VALUE. QUESTIONABLE DUE- TO PERSONNEL AND FACILITY 
CONSTRAINTS • 

ADDITIONAL FACTORS IN ANALYSES REQUIRE MANAGER'S 
JUDGMENT AND EXPERIENCE 

MODELS CANNOT JRODUCE IMPACT STATEMENTS 

DOTS PRINTOUTS REVEALED DATA NOT PREVIOUSLY AVAILABLE" 



. FITCPAC BENEFITS SUIIMARY . 

' * ■ ■ * ; 

' . - . ■ ' • ' .' '' ■ ■ ■ ■' ■ ' 

V TOTAL ANNUAL APPLICATIONS - APPROX 15- 

TOTAL ANNUAL MANHOURS - 750 

■ A ' ■ ■ ■ '• ■ 

POTENTIAL MANPOWER SAVINGS FROM APPLYING fiODELS/DATA 

-BASE - .2 MAN - 

SAVINGS BATIONALE/ASSU^^^^^ ; ' 

- 50X OF IDENTIFIEir EFFORT DEVDTEB TO DATA COLLECTION 
■ . AND MANIPLUATION ' 

- 50Z OF IDENTIFIED EFFORT DEVOTED TO ANALYSIS 
DATA COLLECTION AND MANIPULATION; TIME CAN BE SAVED 
USING MODELS/DaVa BASE 

ADDITIONAL COMMENTS ^ 

- DUE TO LIMITED NUMBER OF COURSES USE OF DOTS MODELS/DATA 
BASE WOULD NOT BE A SIGNIFICANT IMPROVEMENT OVER THE 
PRESENT SYSTEM " . 



61, 



. ^ NWT6P BENEFITS SUHHARY ■> • 

TOrtL ANNUAL APPLICATIONS - APPROX 100 . ^ 

TOTAL ANNUAL MANHOURS - 253^ 

POTENTIAL MANPOWER SAVINGS FROM APPmNG MODELS/JAft 
BASE - Ve MAN : 

SAVINGS RATIONALE/ASSUMPTIONS ' ' 

- m OF IDENTIFIED EFFORT DEVOTED TO DATA COLLECTION : 
AND MANIPULATION 

- 502 OF IDENTIFIED EFFORT DEVOTED TO ANALYSIS 

- . DATA COLLECTION AND mNIPULATION TIME CAN BE SAVED 

USING MODELS/DATA BASE n 

ADDITIONAL COMMENTS \ 

- MAJORITY OF EFFORT IS PROJECTED RATHER THAN 
SINCE ANALYSES ARE NOT CURRENT^ PERFORMED ^ 

- 801 OF TOTAL EFFORT IS ASSOCIATED WITH DATA CALCULATION 
AND MANIPULATION . 



. NWTGP COMMENTS SUMMARY 

JIANY OF THE IDENTIFIED ANALYSES. ARE Ndt CURRENTLY PERFORMED 
kcAUSE- DATA AND TOOLS ARE NOT AVAILABLE 

MANAGEMENT JUDGMENT REQUIRED IN THE PLANNING OF RESOURCE 
APPLICATIONS REPRESENTS A MAJOR PORTION OF TOTAL ANALYSIS 
^EFFORT ' • >l 

DATA BASE WILL NOT BENEFIT THE TRAINING ORGANIZATION AT 
THE DEPARTMENT LEVEL. (MAY BE USEFUL TO CTP/GNET) . 

TRAINING pNITS D0.90X OF THE PAPERWORK TO PROVIDE DATA TO 
HIGHER MANAGEMENT BUT RECEIVE ONLY iOI OF THE BENEFITS 

CONTINUAL ASSESSMENT OF .THE EFFECTS OF REDUCING TRAINING 
RELATED MANPOWER IS ROUTINELY PERFORMED THR0U6HOUT THE 
YEAR • „ 

WE HAVE THE FLEXIBILITY TO COPE (WITH mNlMUM IM^^ 
A 25Z,INCREASE IN TRAINING LOAD IN ANY COURSE 



/ y ' FCDSTCP BENEFITS SUMMARY 

TOTAL ANNUAL APPLICATIONS - APPROX 500 . . 

TOTAL ANNUAL MANHOURS - 3515 

POTENTIAL MANPOWER SAVINGS FROM APPLYING MODELS/DATA 
BASE - .9 MAN 

SAVINGS RATIONALE/ASSUMPTIONS 

- 50% OF IDENTIFIED EFFORT DEVOTED TO DATA COLLECTION 
AND MANIPULATION 

- 50% OF IDENTIFIED EFFORT DEVOTED TO ANALYSIS 

- DATA COLLECTION AND MANIPUUTION TIME CAN BE" SAVED 
US I N^ MODELS/DATA BASE 

ADDITIONAL COMMENTS ^ 

- APPROX 25% OF IDENTIFIED TIME WAS DEVOTED TO ANALYSIS 
OF TRACING LOAD CHANGES 

- TRAINER AND EQUIPMENT UTILIZATION ANALYSIS ACCOUNTED 
FOR ABOUT 30% OF IDENTIFIED TIME 

- ' DEPARTMENT 04 NOT INCLUDED IN ANALYSIS 



FCDSTCP COWMENTS SUMMARY ' 

■ * * . 

• PROJECT MORE FREQUENT EFfORT ON HOSt OF THE APPLICATIONS - 
IN THE FUTURE 

' DECREMENT SCHEDULE MUST PRESENTLY BE MAINTAINED TO RESPOND 
TO CUT REQUESTS 

" DATA MUST CONTINUALLY BE MANIPULATED TO RESPOND TO 

INTERNALLY AND EXTERNALLY GENERATED QUESTIONS ' 

THROUGHPUT CAPABILITY IS CONSTRAINED BY EQUIPMENT 
AVAILABILITY ' - ' 

V ASSESSMENTS NOT NOW PERFORMED WOULD BE IF TOOL^ WERE 
AVAILABLE 
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